Efficient Transmission and Rendering of RGB-D Views
نویسندگان
چکیده
For the autonomous navigation of the robots in unknown environments, generation of environmental maps and 3D scene reconstruction play a significant role. Simultaneous localization and mapping (SLAM) helps the robots to perceive, plan and navigate autonomously whereas scene reconstruction helps the human supervisors to understand the scene and act accordingly during joint activities with the robots. For successful completion of these joint activities, a detailed understanding of the environment is required for human and robots to interact with each other. Generally, the robots are equipped with multiple sensors and acquire a large amount of data which is challenging to handle. In this paper we propose an efficient 3D scene reconstruction approach for such scenarios using vision and graphics based techniques. This approach can be applied to indoor, outdoor, small and large scale environments. The ultimate goal of this paper is to apply this system to joint rescue operations executed by human and robot teams by reducing a large amount of point cloud data to a smaller amount without compromising on the visual quality of the scene. From thorough experimentation, we show that the proposed system is memory and time efficient and capable to run on the processing unit mounted on the autonomous vehicle. For experimentation purposes, we use standard RGB-D benchmark dataset.
منابع مشابه
Robust Real-Time Registration of RGB-D Images using Multi-Resolution Surfel Representations
Fast and robust registration of 3D scans is required in many approaches to perception in robotics such as pose tracking or simultaneous localization and mapping. We propose a novel efficient method to register RGB-D images. We convert the image content into a multi-resolution surfel representation and exploit the dense image neighborhood to construct such views at high frame-rates on a single C...
متن کاملEasy and Fast Reconstruction of a 3D Avatar with an RGB-D Sensor
This paper proposes a new easy and fast 3D avatar reconstruction method using an RGB-D sensor. Users can easily implement human body scanning and modeling just with a personal computer and a single RGB-D sensor such as a Microsoft Kinect within a small workspace in their home or office. To make the reconstruction of 3D avatars easy and fast, a new data capture strategy is proposed for efficient...
متن کاملMatterport3D: Learning from RGB-D Data in Indoor Environments
Access to large, diverse RGB-D datasets is critical for training RGB-D scene understanding algorithms. However, existing datasets still cover only a limited number of views or a restricted scale of spaces. In this paper, we introduce Matterport3D, a large-scale RGB-D dataset containing 10,800 panoramic views from 194,400 RGB-D images of 90 building-scale scenes. Annotations are provided with su...
متن کاملJoint Depth/Texture Bit-Allocation For Multi-View Video Compression
Multi−View display technology allows the presentation of a 3D video by showing simultaneously several views of the same scene. One approach to render these multiple views is to synthesize novel views using a Depth Image Based Rendering (DIBR) algorithm. Consequently, for the efficient transmission of 3D video signals, the compression of texture and also the depth images is required. Since the r...
متن کاملSpectralization: Reconstructing spectra from sparse data
Traditional RGB reflectance and light data suffers from the problem of metamerism and is not suitable for rendering purposes where exact color reproduction under many different lighting conditions is needed. Nowadays many setups for cheap and fast acquisition of RGB or similar trichromatic datasets are available. In contrast to this, multior even hyper-spectral measurements require costly hardw...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2013